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CHAPTER V 


THE CHARACTER OF THE SURVEY DATA 


HENEVER one gathers data for the 

purpose of throwing light upon a 
scientific problem, it is desirable to make a 
preliminary reconnaissance to discover 
whether the data gathered have the valid- 
ity and the pertinence that were expected. 
We shall attempt to do this in the present 
chapter. Our first concern will be with the 
trustworthiness of the results obtained; our 
second, with their adequacy for the purpose 
in hand. 

The best opportunity that is afforded to 
check the validity of the survey data is by 
comparing the relative standings of the four 
cities on moral integration as obtained from 
the cross-section interviews with the stand- 
ings as obtained from the statistical studies. 
If it is found that Gorge City and Bellevue 
are again superior to Mediana and Border- 
town, we may say that the survey and the 
statistical researches confirm one another 
and give added validity to each set of re- 
sults. Since there is no difference in charac- 
ter between the type of survey data which 
is used to measure moral integration and 
that used to investigate leadership and the 
activities of organizations, the establish- 
ment of confidence in the moral integration 
data will serve to validate the data on causal 
factors as well. 

Before proceeding with the analysis of 
the survey data on moral integration, we 
must make one theoretical point of impor- 
tance. One cannot expect that the differ- 
ences between cities on attitudinal data ob- 
tained by interviews will be as great as those 
revealed by our statistical series. The reason 
for this is that if one asks a person, “Is this a 
good city for raising a family?” or “Do 
young people get into trouble much here?” 
the very interpretation of the words “‘good”’ 
and “much” will be largely in terms of local 
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experience. Most persons will not know 
very much about other cities and will tend 
to suppose that their own city is more or 
less normal. Thus, one might expect on the 
first question to get much the same distribu- 
tion of replies from “very good” to “very 
poor” in different cities. Since the norms in 
terms of which evaluations are made tend to 
vary in the same direction as the character 
of the city itself, the evaluations tend to be 
more similar than the objective situations 
justify. This is another way of saying that 
the people who are doing the evaluations 
are not really drawn from the same statis- 
tical universe and that their replies are not 
therefore strictly comparable. Under these 
circumstances the ordinary tests of signifi- 
cance impose too severe a criterion; but, 
since we have no method by which to esti- 
mate the excess of their severity, we must 
use them. This should be kept in mind, how- 
ever, when examining the evidence that 
follows. 

The simplest way to arrive at the com- 
parison between the two pairs of cities on 
the survey data is to find an average for 
Gorge City and Bellevue on each relevant 
item, an average for Mediana and Border- 
town, and to determine the significance of 
the differences between the two averages. 
To the degree that the scores on the items 
which were expected to reflect moral integra- 
tion are significantly different in the right 
direction, the validity of the survey data is 
demonstrated. 

There are two ways of conceiving which 
questions would be most suitable for the 
comparison. One can argue that the ques- 
tions most clearly analogous to the Crime 
Index and the Welfare Effort Index are 
most appropriate, since it was in terms of 
these indexes that the cities were rated on 
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moral integration. Or one can argue that all 
the questions thought to be relevant to 
moral integration should be used, since, after 
all, it is moral integration itself, and not in- 
dexes of it, that we are interested in. Figure 
I presents the data from both viewpoints. 
There are two items that relate closely to 
the crime index and two that relate fairly 
closely to the welfare effort index. These 
four items are starred in the left-hand mar- 
gin of Figure 1. The other sixteen items are 
those that were thought in advance to be 
indicative of moral integration. To the 
degree, however, that this assumption was 
not well founded for particular items there 
would not be significant differences between 
the two pairs of cities. 

Figure 1 shows the differences between 
the two pairs of cities both numerically and 
graphically. The comparison between the 
two columns of figures gives the differences 
in the index scores or the percentages for 


MEAN OF 
BORDER- 
TOWN AND 
GENERAL SATISFACTION WITH THE MEDIANA 
COMMUNITY 
What sort of a city is this to live 
in? 3.89 
Is it a good city for raising a 
family? 3.07 
Do most people think it is a good 
place to live? 4.80 
Respondent believes there is a 
positive attitude among people 
toward the community? 24.6 % 
Respondent would rather live here 
than anywhere else 38.7 % 
LEVEL OF PERSONAL CONDUCT 
*Do young people get into trouble 
much here? 1.96 
*Are citizens law-abiding? 4.31 
How does it compare with other 
cities in this respect? 3.61 
Over-all attitude on desirability 
of fellow-citizens°® 3.84 


____ E 


each item. These differences are represented 
by bars of varying length and direction. 
Those extending to the right from the ver- 
tical base line indicate superiority of Gorge 
City and Bellevue on these items. Bars ex- 
tending to the left indicate inferiority of 
these cities. The index scores and percent- 
ages have been so scaled that the point at 
which a difference becomes significant is the 
same distance from the base line. The bars 
are black beyond the point of significant 
difference. Those having the longest black 
sections correspond to the items showing 
the greatest significant differences. 
Whether one takes the four items most © 
closely related to our Crime Index and our 
Welfare Effort Index or considers Figure 1 
as a whole, it is clear that there is a strong 
tendency for Gorge City and Bellevue to 
appear superior to Bordertown and Medi- 
ana. On each of the four asterisked items 
the difference is in favor of Gorge City and 


MEAN OF 
GORGE CITY 
AND 
BELLEVUE 


DIFFERENCES? 


INDEXES 


4.19 
3.90 
PERCENTAGES ate 
29.5 % 
53-6 % 
INDEXES 


2.78 
4.61 
3.81 
4.08 


Differences in scores between the two pairs of cities are significant at the 95 per cent level of confidence as follows: indexes 
(ranging from 5.00 to 1.00) when the difference is o.22 or more; percentages between 20 and 80 when the difference is 11 per cent 
or more; percentages less than 20 and greater than 80 when the difference is 8 per cent or more. The bars in the figure are black 


beyond the point of significance. 


b A more correct heading here would be: ‘‘Percentage of Respondents Who Believe That There Is a Positive Attitude among 
People toward the Community.” To save space, the shortened form has been used for all items of this type. In this particular case 
the percentage shown is made up of those who followed up the prior question with ‘“‘people who go away come back to live,” “people 


take pride in the city,” or ‘‘people say good things about the city.”’ 


© Such over-all attitudes were determined by the coders after reading the entire document on each respondent. 


Fic. 1.—Survey data on moral integration, two pairs of cities. (High scores indicate high moral integra- 


tion no matter how the question is stated.) 
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Bellevue, and in three of the four cases it is 
significant. If all twenty items are consid- 
ered, twelve show significant differences in 
favor of Gorge City and Bellevue, six show 
differences in the same direction but, in 
varying degrees, less than significant. The 
differences on the two items represented by 
the bars that extend to the left are not 
nearly large enough to be significant in 
favor of Bordertown and Mediana. 

Figure 1 gives us a good opportunity to 
determine what we can and cannot expect 
from our survey data. Since we have very 
definite evidence from the statistical series 
that Gorge City and Bellevue have a higher 
level of moral integration than Mediana 
and Bordertown, we can assess the ability 
of the survey data to measure such differ- 
ences. Our evidence seems to be clear that 
the survey data will not yield significant dif- 
ferences in the wrong direction; that they 
will not give us false information. On the 


PARTICIPATION IN Civic AFFAIRS 


Do people take an interest in community affairs? 

*Over-all code on respondent’s interest in commu- 
nity 

Are you doing as much for the community as you 
want to, or should you be taking a more active 
part? 

Have you as much to do with what goes on here as 
the average person? 


Did you vote in the last election? 


RELATIONS AMONG GROUPS 


Is there a big difference between rich and poor? 

Respondent’s own attitude toward class differences 
(coder’s item) 

Is there much trouble among different races, na- 
tionalities, and religions? 

How does it compare with other cities in this re- 
spect? 


Respondents who state that the way groups get 
along is no problem 

Over-all code on whether respondent thinks in 
terms of group conflict or not (percentage who 
do not) 
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other hand, it is also clear that questions 
which one might expect to measure certain 
dimensions of the city’s life will not always 
do so accurately. The relativity of the 
norms being employed by the respondents, 
as explained above, often serves to mask a 
difference that is in fact present. The upshot 
of the matter is that, whenever a significant 
difference appears between our cities, we 
may assume that there is in fact a difference 
but that, whenever no significant difference 
appears, we cannot assume that there is in 
fact no significant difference. If, in our 
treatment of the various facets of these 
cities, we draw our conclusions only from 
those situations where there is either a 
clearly significant difference on a single 
item or a cumulation of just-less-than-sig- 
nificant evidence on related items, we shall 
probably be on safe ground. 

When our four cities were selected on the 
basis of the statistical studies, it was thought 


MEAN OF MEAN OF 
BORDER- DIFFERENCES GORGE CITY 
TOWN AND AND 
MEDIANA BELLEVUE 
INDEXES 
3-17 3-25 
2.03 3.20 
2.55 2.56 
2.54 2.61 
PERCENTAGES 
47.9% ECCE 64.4 % 
INDEXES 
2.56 3.01 
3.30 3.52 
3.79 4.16 
3.78 3-70 
PERCENTAGES 
12.7 % 19.3 % 
61.3% 83.7 % 


Fic. 1.—Continued 
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CITIES GENERAL SATISFACTION LEVEL OF PERSONAL 
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INDEXES 
What sort of a city is this to live in? Do young people get into trouble 
much here? 
BELLEVUE 
GORGE City 
BORDERTOWN 
MEDIANA 


Ts it a good city for raising a family? Are citizens law-abiding? 


BELLEVUE 
GORGE CITY 
BORDERTOWN 
MEDIANA 


Do most people think it is a good How does it compare with other 
place to live? cities in this respect? 
BELLEVUE 
GORGE CITY 
BORDERTOWN 
MEDIANA 


Over-all attitude on desirability of 
fellow-citizens 
BELLEVUE 
GORGE CITY 
BORDERTOWN 
MEDIANA 


PERCENTAGES 


Respondent believes there is a posi- 
tive attitude among people toward 
the community 


S 
BELLEVUE 


GORGE CITY 
BORDERTOWN 
MEDIANA 


Respondent would rather live here 
than anywhere else 
BELLEVUE 
GORGE CITY 
BORDERTOWN 
MEDIANA 
Fic. 2.—Aspects of moral integration in four cities. (The size of a significant difference, at the 95 per cent 
level of confidence, between any two cities for each item is shown at the end of the longest bar under that 


item.) 
30 
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PARTICIPATION IN 
CIVIC AFFAIRS 


Do people take an interest 
in community affairs? 


Over-call code on respond- 
ent’s interest in the com- 
munity 


Are you doing as much for 
the community as you want 
to, or should you be tak- 
ing a more active part? 


Have you as much to do 
with what goes on here as 
the average person? 


RELATIONS AMONG 
GROUPS 


INDEXES 


Is there much trouble among dif- 
ferent races, nationalities, and re- 
ligions? 


How does it compare with other 
cities in this respect? 


Is there a big difference between 
rich and poor? 


Respondent’s own attitude toward 
class differences 


PERCENTAGES 


Did you vote in the last 
election? 


Respondents who state that the 
way groups get along is no prob- 
lem 


Over-all code on whether respond- 
ent thinks in terms of group con- 
flict 


Fic. 2.—Continued 
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CITIES 


BELLEVUE 
GORGE CITY 
BORDERTOWN 
MEDIANA 


BELLEVUE 
GORGE CITY 
BORDERTOWN 
MEDIANA 


BELLEVUE 
GORGE CITY 
BORDERTOWN 
MEDIANA 


BELLEVUE 
GORGE CITY 
BORDERTOWN 
MEDIANA 


BELLEVUE 
GORGE CITY 
BORDERTOWN 
MEDIANA 


BELLEVUE 
GORGE CITY 
BORDERTOWN 
MEDIANA 
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that they would represent two situations: 
one in which certain variables other than 
heterogeneity and mobility were strongly 
working in a positive direction and one in 
which such variables were strongly working 
in a negative direction. It was assumed, 
therefore, that Gorge City and Bellevue 
would be found to be alike in many respects 
but that they would be quite different from 
Mediana and Bordertown, which would, 
however, form a similar pair. Indeed, it was 
originally thought probable that the sam- 
ples from the two high cities could be treated 
as coming from a single universe, and the 
samples from the two low cities similarly. 
This would have made possible analysis in 
terms of contrasted two-hundred-case sam- 
ples, which would have cut down considera- 
bly the size of differences that are significant. 

These hopes of merging the data from 
Bellevue and Gorge City, on the one hand, 
and Mediana and Bordertown, on the other, 
were abandoned as soon as the data had 
been analyzed in preliminary fashion. The 
reasons clearly appear in Figure 2. It is 
readily seen that there is little general 
tendency for the cities to retain their pair 
relationships throughout the questions. Al- 
though the “normal” pattern of two longer 
bars above and two shorter bars below is 
found in thirteen of the twenty cases, in 
only three cases are each of the higher cities 
significantly superior to each of the lower 
cities. The fact of the matter is that each of 
the four cities seems to have a distinctive 
character. Bellevue is well integrated in 
somewhat a different way than Gorge City, 
and Bordertown and Mediana are poorly 
integrated each in its own peculiar manner. 

Because of the individuality of each com- 
munity that our data reveal, it would be 
unwise to combine the findings of the two 
cities in each pair. The factors that make for 
the high degree of moral integration in Belle- 
vue might well be different from those that 
make for that in Gorge City. If the data 
were mingled, the two causal patterns might 
obscure one another; whereas, if the data 
are treated separately, the distinctive causal 
patterns should become apparent. Through- 


out the analysis of the survey results we will 
therefore deal with the four cities as inde- 
pendent situations rather than in the man- 
ner originally intended. 

This method of procedure does not mean 
that we are forsaking our original objectives. 
We are still trying to determine whether 
leadership and the activities of organiza- 
tions are important causal factors in pro- 
ducing moral integration in cities. The only 
difference is that instead of comparing two 
situations we will be comparing four. By 
doing so, we may be able to obtain leads for 
the analysis that we would otherwise miss. 
In the end our conclusions will have to 
square with the facts in all four cities. 
This amounts to saying that the results for 
the two high cities and the two low cities 
will have to be analytically combined at the 
end instead of having their data statistically 
combined at the beginning. 

The analyzed data from our four cities 
will be presented in two ways in the chap- 
ters that follow. First, chapters will be de- 
voted to each of the cities separately in order 
to give the reader a “feel” for them. In these 
chapters what we have learned about the 
character of these urban communities will 
be set forth. In giving the information on 
both moral integration and its causes, scores 
for the particular city will be contrasted 
with the mean scores for the four cities. 
Since Gorge City and Bellevue were very 
high in the moral integration range, while 
Mediana and Bordertown were some dis- 
tance from the bottom, these mean scores 
represent a hypothetical city that is slightly 
above the middle of the whole range of cities 
—say a city like Trenton, Grand Rapids, 
or Toledo. After these four chapters, the 
treatment will shift to an analysis that cuts 
across the cities in terms of questions rele- 
vant to sociological theory. It is from these 
chapters that it is hoped to obtain contribu- 
tions that will be suggestive, not only to the 
social scientist, but to the community 
planner and the community leader as well. 
It would be unfortunate if our results had 
no bearing upon practical programs looking 
toward the improvement of city life. 
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